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ABSTRACT. The postive semidefinite rank of a nonnegative (m x n)-matrix S is the min- 
r-{ [ imum number q such that there exist positive semidefinite (q x g)-matrices Ai, . . . , A m , 

Bi, . . . , B n such that S(k,£) = trAlBe. Just as the nonnegative rank characterizes the 

minimum size of formulations of combinatorial optimization problems as linear programs, 

the positive semidefinite rank characterizes their minimum size as positive semidefinite 

programs. 

The most important lower bound technique on nonnegative rank only uses the zero/non- 
^^ , zero pattern of the matrix. We characterize the power of lower bounds on positive semi- 

f ) ■ definite rank based on the zero/non-zero pattern. We then use this characterization to prove 

lower bounds on the positive semidefinite ranks of families of matrices which arise from 
i^h , the Traveling Salesman and Max-Cut problems. 
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\Q • 1. Introduction 
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CO ■ In this paper, Ik is a subfield of the field C of complex numbers. For a matrix A over Ik, 

£T) [ we denote its entries by A(k, £). As usual, A*{k, £) = A(£, k) is the Hermitian transpose, 

and A is positive semidefinite, if A is square, A* = A, and all complex eigenvalues are 
nonnegative. We let D< + := Ik fl R+ denote the nonnegative numbers in Ik. A matrix is 
nonnegative if all its entries are nonnegative. 

Let S be an m x n nonnegative matrix over Ik. The nonnegative rank of S, denoted by 
^ | rk+(5) is the smallest number q such that there exists a nonnegative factorization of 5 of 

size q, i.e., vectors £1, . . . , £ m , rji, . . . ,rj n G k^ such that S(k, £) = (£& | %), where the lat- 
ter is the standard inner product in k q . Similarly, the positive semidefinite rank of S, denoted 
by rkg(5), is the smallest number q such that there exists a. positive semidefinite factoriza- 
tion of S of size q, i.e., positive semidefinite (q x q)-matrices Ax, ... , A m , B\ , . . . , B n such 
that S(k, £) = ti{A* k Bf), the latter expression being the usual inner product of two square 
matrices. These two definitions are examples of the concept of factorization rank, where 
one wishes to write the entries of a matrix S as inner products of vectors in some Hilbert 
space, with diverse restrictions on the set vectors which are allowed. 
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The nonnegative rank is a well-known concept in Matrix Theory, see e.g. [17, 12, 3], 
Generalizations to other types of factorizations are of interest there, too, see e.g. [3, 2]. 
In [2], the factors £& and r\i are required to be in R q , where it! is some fixed semiring, e.g., 
a sub-semiring of R + . To the best of our knowledge, replacing R q by a cone (in some inner 
product space over an ordered field) which is not a product of 1 -dimensional cones appears 
to be a new concept initiated by Gouveia, Parrilo, and Thomas [10]. 

There is a beautiful connection between (1) factorization ranks, (2) linear mappings be- 
tween convex cones, and (3) combinatorial optimization, which was first noted by Yan- 
nakakis [22] in 1991 for the nonnegative rank, and later extended by Gouveia, Parrilo, and 
Thomas [10]. Driven by these connections, the last several years have seen a surge of inter- 
est in factorization ranks, particularly the nonnegative rank, and recently also the positive 
semidefinite rank. As far as the link to combinatorial optimization is concerned, bounds — 
upper or lower — on the nonnegative or positive semidefinite rank provide corresponding 
bounds on the sizes of linear programming or semidefinite programming formulations of 
problems. Finding lower bounds on these factorization ranks is a difficult task, and draws 
on methods from combinatorial matrix theory and communication complexity. 

For the nonnegative rank, the easiest, most successful, and more or less only method (but 
see [8]) for obtaining lower bounds just considers the support of the matrix. The support 
of S is the matrix obtained from S by replacing every non-zero entry by 1. For an m x n 
matrix S whose support is M , the best lower bound obtainable by considering the only the 
support is 

min{rk+(T) | supp(T) = M, T > 0}. 
This turns out to be equal to the Boolean rank of M [12], the smallest r such that there 
are r dimensional binary vectors x\, . . . , x m G {0, l} r and yi, ■ ■ ■ ,y n G {0, l} r satisfy- 
ing M(k,£) = \/ T j =1 Xk(j)ye{j)- The Boolean rank arises in many contexts, and is also 
known as rectangle covering number [6], biclique covering number [18] or, after taking 
log 2 , nondeterministic communication complexity [22]. Most lower bounds on nonnegative 
rank actually lower bound the Boolean rank, including for the recent result showing super- 
polynomial lower bounds on the size of linear programming formulations of the traveling 
salesman problem [7]. Notable exceptions to this rule include results of [22] and [14, 15]. 

This paper deals with the question of giving lower bounds for the positive semidefinite 
rank. Given the situation for nonnegative rank, it is natural to ask the following question. 

Question. How good can support-based lower bounds for positive semidefinite rank be? 

In the case of the nonnegative rank, there are plenty of examples where the Boolean rank 
is exponential in the rank. Moreover, it is not difficult to see that even the Boolean rank of 
the support of a rank-3 matrix can be unbounded [3]. In the case of the positive semidefinite 
rank, we will see that this is not the case: the best possible support-based lower bound for 
the positive semidefinite rank coincides with the minimum rank over all matrices with the 
same support. 

Theorem 1.1. For all 0/1-matrices M, we have 

min{rk ffi (T) | supp(T) = M, T > 0} = min{rk(T) | supp(T) = M) 
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The theorem answers completely the question what lower bound information can be 
gained about the positive semidefinite rank from the zero/non-zero pattern of a nonnega- 
tive matrix: the best possible bound is the minimum possible rank of a matrix with the 
given zero/non-zero pattern. De Wolf [21] calls this number the nondeterministic rank, and 
shows that the logarithm of the nondeterministic rank characterizes nondeterministic quan- 
tum communication complexity. We therefore have the pleasing parallel that the logarithm 
of the best support based lower bound for nonnegative rank is the nondeterministic commu- 
nication complexity, while the logarithm of the best support based lower bound on positive 
semidefinite rank is the nondeterministic quantum communication complexity. 

In the situation of the nonnegative rank, there is a connection between the Boolean rank 
and embeddings of posets: The Boolean rank of M is the minimum number of co-atoms of 
a truncated Boolean lattice into which a certain poset defined by M can be embedded. We 
prove a corresponding statement for the best-possible support-based lower bound for the 
positive semidefinite rank in Section 3. 

Application to Combinatorial Optimization. Lower bounds of size 0(rk S) can still be use- 
ful. The reason for this is that, whereas the nonnegative rank is lower-bounded by the rank, 
the positive semidefinite rank of a matrix S can be as low as 1 y/2 rk S. Indeed, in sev- 
eral important situations in combinatorial optimization, the rank of the relevant matrices is 
0(n 2 ) (for nonnegative integers n), whereas 0(n) upper bounds on the positive semidef- 
inite rank are known. The most impressive example is probably the Goemans-Williamson 
Positive Semidefinite Programming relaxation of Max-Cut [9]. 

In combinatorial optimization, one very often has a polyhedron Pq of which one knows 
the vertices and extreme rays, as well as a polyhedron P\ containing Pq, of which one 
knows the facets. We say that P\ is a relaxation of Pq. (Typically, there are several relax- 
ations of Pq which are of interest in the combinatorial optimization community.) Then, in 
combinatorial optimization, one is faced with the following problem. 

Problem. Find a (linear or positive semidefinite) "extended formulation " for Pq which 
"dominates" (i.e., is "at least as good" as) the relaxation P\, but which is "smaller" — or 
prove a lower bound on the size of such an extended formulation. 

We will make the terminology clear in the next section, where we also explain the con- 
nection between extended formulation size and factorization ranks. Here, we only vaguely 
describe the results we obtain on two well-known combinatorial optimization problems: the 
Max-Cut problem and the Traveling Salesman problem. 

Both problem have a parameter n which denotes the number of vertices of the graph on 
which the optimization problem is defined. 

There is a very easy relaxation P±° such that the Goemans-Williamson relaxation fits be- 
tween the Max-Cut polytope and P±°. The Goemans-Williamson relaxation has size n, and 
we show that this is tight: every positive semidefinite extended formulation which domi- 
nates P\° has size at least n. For two other well-known relaxations, the one described by the 



Trivially, if a positive semidefinite factorization of size q exists, the rank of S can be at most ( q t ) 
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so-called "triangle inequalities" and the one described by the so-called "clique inequalities", 
we prove that every positive semidefinite extended formulation dominating the relaxation 
has size fi(n 2 ). The rigorous formulation of these results can be found in Theorem 2.5. 

For the Traveling Salesman Problem, we prove that every positive semidefinite extended 
formulation dominating the well-known Dantzig-Fulkerson-Johnson relaxation (this is the 
one which gives the Held-Karp bound) has size Q(n 2 ), see Theorem 2.8. 

2. Factorizations, Polyhedra, and Combinatorial Optimization 

There is a well-known connection between linear mappings between cones and factor- 
izations of corresponding matrices. In this section, let k be a subfield of the field (R of real 
numbers. Let S be a non-negative matrix, and suppose that S = AX for an (m x d)- 
matrix A and ana(dx n)-matrix X, both of rank d. In other words, we are given a rank-d 
factorization of S. Let Qo C k d be the polyhedral cone generated by the columns of X, 
and denote by Qi the polyhedral cone {x G k d \ Ax > 0}. Clearly, since S > 0, we have 
Qo <= Qi- The rank condition on A and X is equivalent to Qo, Q\ having dimension d. 

A linear extension of Qo C Q 1 of size q is a polyhedral cone Q in some k s with q facets 
for which there exists a linear mapping ir: k s — > k d such that Qo C ir(Q) C Q\. The 
following is a well-known fact, going back to Yannakakis. 

Theorem 2.1 ([22], c.f. [6]). The minimum size of a linear extension of Qo C Q\ equals 
the nonnegative rank of S. 

A positive semidefinite extension of Qo ^ Q\ of s i ze 1 is the intersection Q of a linear 
subspace of some M(g x g) with the set of all positive semidefinite (g x g^-matrices, for 
which there exists a linear mapping -k : k s — > k d such that Qo ^ ^(Q) ^ Qi- The following 
fact is a straightforward generalization of a recent result by Gouveia, Parrilo, and Thomas. 

Theorem 2.2 ([10], c.f. [20]). The minimum size of a positive semidefinite extension of 
Qo ^ Q\ equals the positive semidefinite rank of S. 

The situation of Theorems 2. 1 and 2.2 is very common in combinatorial optimization. 
There, one usually starts with a polyhedron Po defined as the convex hull of points corre- 
sponding to feasible solutions to a combinatorial optimization problem. Finding the optimal 
solution would then require to optimize a linear function over Po- F° r this optimization to 
be efficient, one would like a system of linear (or positive semidefinite) inequalities which 
describes Po- However, very often, obtaining such a description is elusive. Hence, one 
uses a relaxation, which is a polyhedron P\ containing Po, defined by a set of linear in- 
equalities satisfied by feasible solutions to the original problem. At this point, one studies 
so-called extended formulations. These are linear/semidefinite models of the optimization 
problem which may use a larger number of variables, such that the projection onto the origi- 
nal variable space contains Po, and is at least as good as the relaxation Pi. One is interested 
in finding extended formulations with a small number of inequalities, or to prove lower 
bounds on the number of inequalities needed. 
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Since working with polyhedra that are not cones poses some unnecessary complications 
(among them the need to consider projective mappings ir instead of linear ones), one con- 
siders Qo, Q\, the homogenizations of Pq, P\. It is generally safe to assume that 

• Pq has dimension d — 1 and 

• that Pi is pointed (i.e., it has a vertex; this is equivalent to the inequality system 
defining P\ having full rank). 

These two conditions imply that the rank of the slack matrix equals d. (We leave it to the 
reader to convice himself of that after studying Remark 2.3.) Thus, one is in the situation 
of the two theorems above. 

For the reader who wishes to know more about the combinatorial optimization point of 
view, we recommend, as a starting point, the article by Kaibel [13]. 

Let us make precise how, from the definitions of the polyhedron Pq, generated by points 
and rays, and the polyhedron Pi, described by a system of linear inequalities, the slack 
matrix S of for the polyhedral cones Qq C Qi are obtained. 

, y n2 be points in [k rf x , and oi, . . . , a m i E D< rf_1 



Remark 2.3. Let x\, . . . , x ni and yi, 

and ai, . . . , a m i E Ik be such that aTx? > a& for all A; = 1, 



,m',l 



1, 



,ni and 



Ofc2/£ > for all k = 1, ... , m' , 1 = 1,..., n^. In other words, the polyhedron 
P := cvxhulljxi, ...,x ni } + cvxconejyi, . . . , y n2 } 

is contained in the polyhedron 

P\ := {x | a],x > at V/c = 1, . . . , m'}. 
With n := n\ + n2 and m := 2m' + 1, define the (d x ?i)-matrix 

1 ... 1 ... 



X :-- 



xi 



• hi 



Hi 



Un2 



and the (m x d) -matrix 



/ -a\ aj \ 



A 







V 



<i 

1 Od-J 

Then the convex cone Qo generated by the columns of X is the homogenization of Pq, and 
the convex cone Q\ defined by the system Ax > is the homogenization of Pi. The entries 
of the slack matrix S = AX can be obtained from the original data as follows. For each 
k = 1, . . . , m! and each £ = !,..., n\, we have the entry 

S(k,£) = a T k xi-a k ; 
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for each k = 1, . . . , m' and each 1 = 1, 


. . , ri2, we have the entry 


S(m' + k, ni +£) = 


a T k ye; 


for the last row, we have 




S(m,£) = 


( 1, for £ = 1, . . . , m 
1 0, fori = m + l,.. 



n. 



2.1 . Our results on Max-Cut and TSP. 

The Maximum Cut Problem (Max-Cut) is the following NP-hard combinatorial optimization 
problem. Given a complete graph K n on n vertices with vertex set [n] and edge set E n := 
(v) and a weight function c: E n — > Q, find an edge cut C (i.e., inclusionwise minimal 
disconnecting set of edges) of A' n which maximizes the total weight 

E c ( e )- 

eGC* 

Solving Max-Cut amounts to optimizing a linear function of the the famous cut polytope 

Pq ■= {x(C) C edge cut in K n \, 

where x(C) denotes the characteristic vector in k En of the set C. 

Many linear relaxations of the cut polytope are known; probably the best known is the 
one comprising the triangle inequalities: 

Pi := < x G Ik n x uv < x uw -\- x wv for all ordered triples (u, v, w) G [n] 3 >. 

The inequalities in the following relaxation are called clique inequalities: 

iV := [x £k E "\ Y^ x e< |Lr| 7 4 for a11 E/C[n]l. 

ee-E(CZ) 

Remark 2.4. While the Goemans-Williamson relaxation is a linear-sized positive semidef- 
inite extension of P C P! C , every linear extension of this relaxation has exponential size. 
(We prove this in Appendix A.) 

Discarding almost all of the clique inequalities, we get the following, very simple relax- 
ation: 



Pi° := ie k 



En 



x e < 1 for a\\e £ E n >. 

The clique inequalities can be strengthened to the odd-clique inequalities of Barahona & 
Mahjoub: YleeE(U) °° e — L'' 7 ' / 4 J for all odd-cardinality U C [n]. Here, for our lower 
bound, we require only a small number of them: 

-Pi 3 ° c := \x G Ik^ 71 x nt , + x vw + x u ^ < 2 for all u,v,w £ [n];|. 

We prove that the size of any semidefinite extension which dominates the nonnegativity 
and upper-bound inequalities (as the Goemans-Williamson relaxation) on the variables must 
be at least the size of the Goemans-Williamson relaxation. Moreover, adding even the 
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most basic inequalities (triangle or 3 -odd-clique) inequalities will blow up any semidefinite 
extension to Q(n 2 ). 

Theorem 2.5. With the above terminology: 

(a) Every semidefinite extension of Pq CPi° has size at least n. 

71 

(b) Every semidefinite extension of Pq C Pi has size at least (1 — o(l)) — . 

ft 

(c) Every semidefinite extension of Pq C P^ oc has size at least (1 — o(l)) — . 

Remark 2.6. Item (a) is best possible since it matches the size of the Goemans-Williamson 
relaxation. Indeed, for this relaxation, the support-based lower bound, the trivial rank lower 
bound (Footnote 1) and the upper bound all coincide. 

Items b and c are (asymptotically) the best possible bounds obtainable by support-based 
methods, since the dimension of the polytope P i s i s (1 ~~ o(l)) z ^-, and P\°, Pi A , and 
Pi 3oc are all pointed. Hence the rank of the slack matrix is (1 — o(l))\. 

Note that both the triangle inequalities defining Pi A and the 3-odd-clique inequalities 
defining p 1 3oc are special cases of the well-known cycle inequalities 

x(F) -x(D\F) < \F\ - 1 

for every (edge set of a) cyle D in K n and F C D with \F\ = 1 mod 2. The cycle 
inequalities are arguably the most basic linear inequalities for Max-Cut. From each of (b) 
and (c) of Theorem 2.5, we obtain the following consequence. 

Corollary 2.7. Every semidefinite extension for Max-Cut which dominates the cycle in- 

2 

equalities has size at least (1 — o(l))^-. 

For the Symmetric Traveling Salesman Problem (STSP), given a complete graph K n on n 
vertices with vertex set [n] and edge set E n and a length function E n — > Q, one is asked 
to find a Hamilton cycle in K n of minimum total length. Solving the STSP amounts to 
optimizing a linear function over the STS polytope 

Po '■= \ x(C) C e dge set of Hamilton cycle in K n > , 

where, again, x(C) denotes the characteristic vector in k En of the set C. 

Solving the STSP usually starts with the Dantzig-Fulkerson-Johnson relaxation [5]: 

pM) ■= [ x e k E " 



T,ue[n] x uv = 2 forallve[n]; 

EeeE(u) x e > 2 for all U C [n], 1< \U\ < »/a; 

x > }. 

Optimizing over Pi df J yields the so-called Held-Karp bound. 

There are also a few semidefinite formulations for the STSP, most notably the one by 
Cvetkovic et al. [4]. We prove the following. 
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Theorem 2.8. Every semidefinite extension of Pq C Pi dt -> has size at least I 

The bound in the theorem is (asymptotically) the best possible obtainable by support- 
based methods as the dimension of the polyhedron Pq is ("g ) — 1> an d hence the rank of 
the slack matrix is at most ("g ) . 

3. POSET EMBEDDING RANKS 

In this section we give a more combinatorial interpretation of the number min{rk®(5) | 
supp5 = suppM}. 

Definition 3.1. Let S be an (m x n)- matrix. We define the poset V{S) of S as 
7>(5):=({0}x{l,...,m}U{l}x{l,...,n}, ^), 

where 

(i,k)±(j,£) :^ i = 0Aj = lAS(k,£)^0. 

In other words, V(S) is the poset whose Hasse-diagram is the bipartite graph with lower 
level vertex set the row set of 5 and upper level vertex set the column set of S, and a vertex k 
of the lower level adjacent to a vertex £ of the upper level if and only if S(k, £) = 0. 

Definition 3.2. Let V, Q be posets. An embedding of V into Q is a mapping j : V — > Q 
such that x < y ^=^ j(x) < j(y) holds for all x, y G V. 

Definition 3.3. Let S be a matrix, 3? a set of posets, and "1 : & — > D\l. We define the 2?- 
embedding rank of S as the infimum over all 3(<2) such that there exists an embedding of 
V(S) into Q. 

As mentioned in the introduction, the Boolean rank of a Boolean matrix S is equal to the 
^-embedding rank of V (S) , with g? the set of truncated Boolean lattices 1 ( Q) the number 
of co-atoms of Q [6]. 

By a subspace lattice we mean the lattice of all linear subspaces of k q , for some q G N. 
If Q is the lattice of all subspaces of k q , then we let 3(Q) := q. With Jzf the set of 
all subspace lattices, it is clear that the Jzf-embedding rank, which we denote by rk*(M), 
equals the minimum dimension of a vector space in which there exist subspaces Ui, . . . , U m 
and V\ , . . . , V n such that 

U k C Vt if, and only if, S(k, £) = 0. (1) 

In the proof of Theorem 1 . 1 , we will prove en passant the following proposition. 
Proposition 3.4. For all nonnegative (m x n) -matrices S, we have 

rk + (S') = min{rk0(T) | supp(T) = supp(S'), T > 0}. 
More importantly, 

(a) Every positive semidefinite factorization S(k,£) = tx{A* k B() gives rise to a subspace- 
lattice embedding of S of the same size by letting Uk '■= ker Ak and Ve := imi?^. 
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(b)Ifk = R, then in (a) we may assume that dim £4. < (y/8n + l)/2 and codimV^ < 
(V8m + l)/2. 

It will become clear in the proof that, while the minimum in the subspace-lattice em- 
beddedding rank is always attained by (co-)dimension 1 subspaces, this is not true for the 
subspace-lattice embedding arising from a positive semidefinite factorization. 

The proposition also shows that the situation for positive semidefinite factorizations mir- 
rors that for nonnegative factorizations. The subspace-lattice embeddedding rank is the 
minimum "size" H(Q) of a poset Q of a certain type into which V(S) can be embedded. 
The importance of such "poset embedding ranks" for factorization ranks has been noted 
before: it is implicit in [6] that the Boolean rank of a boolean matrix S is equal to the 
minimum number of co-atoms in a co-atomic poset 2 into which V(M) can be embedded. 

4. Proof of Theorem 1.1 and Proposition 3.4 

In this section we prove Theorem 1.1 and Proposition 3.4. For this, we show the follow- 
ing four lemmas. 

Lemma 4.1. For all nonnegative matrices S we have 

rk®(5) > min{rk(T) | supp(T) = supp(M)}. 

Lemma 4.2. For all matrices S 

rk(S) > rK(S). 

The subspaces U^ in the embedding can be chosen of dimension 1, and the subspaces Vg of 
co-dimension 1 (and vice-versa). 

Lemma 4.3. For all 0/1 matrices M, we have 

rk*(M) > min{rk e (T) | supp(T) = M, T > 0}. 

Lemma 4.4. Let S be a nonnegative matrix. Every positive semidefinite factorization 
S(k,£) = tT(Af.B(i) gives rise to a subspace-lattice embedding of S of the same size by 
letting Ufc := ker A^ and Vg := imi^. 

Lemma 4.5. Suppose D< = R, and S is a nonnegative (m x n)-matrix. If a factorization 
of S of size q exists, then there exists one S(k, £) = tr(A^Bi) with rk A^ < (y/8n + l)/2 
andrkB e < (y/8m + l)/2 for all k, I 

Theorem 1.1 and the equation in Proposition 3.4 now follow by sticking together the in- 
equalities. Proposition 3.4(a) follows from Lemma 4.4, and Itemb follows with Lemma 4.5. 
We start with Lemma 4.1. Before we prove it, we note the following easy fact. 



9 

Recall that a poset is co-atomic if every element is a meet of maximal elements. The maximal elements 
are then called co-atoms. 
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Lemma 4.6. Suppose that S(k, i) = tr A* k B^, k = 1, . . . , m, £ = 1, . . . , n is a positive 
semidefinite factorization of S with matrices of order q. Then there exists a finite union H of 
proper sub-varieties of (k q ) m+n such that for any (£i, . . . , £ m , rji, . . . , %) E (k q ) m+n \ H 
we have: 

{A k £ k \B m )=0 <=> S(k,£)=0 

In the case of D< E {R, C} one can state more easily that H is a set of Lebesgue-measure 
zero. 

Proof of Lemma 4.6. To have (A k ^ k \ Bgrji) ^ for all (k,£) with S(k,£) / 0, we need 
to choose (£, 77) which do not satisfy any of the following equations: 

(& I A k B m ) = 0; (k, £) with S(k, £) jt 0. 

Each of these equations defines a proper sub-variety of (k q ) m+n , since / S(k, £) = 
tiA^B^ implies A k Bi 7^ 0. (This is most easily seen by realizing that, for X := \J~~A, 
Y := y/B, we have tr A*B = ||Xy|| 2 where \\Z\\ := tr Z*Z refers to the Frobenius- (or 
Hilbert-Schmidt-) norm of the matrix Z.) □ 

We can now complete the proof of Lemma 4.1. 

Proof of Lemma 4.1. We have to show that for every nonnegative real matrix S there exists 
a matrix T with supp(T) = supp(S) and rk® 5 > rkT. 

Let S be nonnegative and real with rk® S = q, and let A k , Be £& and rj£, k = 1, . . . , m, 
£ = 1 . . . , n as in Lemma 4.6. The matrix T defined by T(k, £) := (A k £,k \ -£>£%) has the 
same support as S and rank at most q = rk® 5. □ 

Proof of Lemma 4.2. We have to show rk*(S) < rk(5) for all matrices S. Let q := rkS. 
We give subspaces of a q-dimensional vector space W satisfying (1). 

For k = 1 , . . . , m, denote by s k E k n the vector which constitutes the A;-th row of 5, 
i.e., s k = S(k, . . . ) T , and the let U k := ks k , the linear subspace of k n generated by s k . The 
ambient space for our construction is W := J2k=i Uk> a vector space of dimension q. For 
£ E {1, . . . , n}, let Kg denote the set of columns indices k with S(k, £) = 0, and define 

V e := J2 U k = span{s fc | S(k,£) = 0}. 
keKe 

Clearly, U\ , . . . , U m , V\ , . . . , V n are linear subspaces of a real vector space of dimension q. 
Moreover, by construction, we have U k C Ve whenever S(k,£) = 0. But since 

V e C {x E k n I x(k) = V k E Ki} : 

we have that S(k, £) 7^ implies U k <£ Vg, and we conclude (1). □ 

Proof of Lemma 4.3. We have to show rk*(M) > min{rk®(T) | supp(T) = M,T> 0} 
for all 0/1 matrices M. For this, from subspaces of k q satisfying (1) with S replaced by M, 
we constuct a matrix T and a positive semidefinite factorization with matrices of order q. 

Let Ui, . . . , U m , Vi, ■ ■ ■ , V n such a collection of subspaces. Fix any inner product of k q , 
and denote by A k the matrix of the orthogonal projection of k q onto U k and by B«- the 
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matrix of the orthogonal projection of D< 9 onto Vg, by Id the gxij identity matrix, and let 
Bi := Id — B^~. Clearly A k and Bg are positive semidefinite, and we have A k Bi = 
if and only if M(k,£) = 0. Thus, T defined by T{k,£) := ti A* k B e is a matrix with 
supp(T) = M, and A k , Bi a positive semidefinite factorization. □ 

Proof of Lemma 4.4. From a positive semidefinite factorization with matrices of order q, 
we will construct subspaces of k q satisfying (1). 

Let a positive semidefinite factorization of S be given, i.e., let At, ... , A m , B±, . . . , B n 
be q x q real positive semidefinite matrices with S(k,£) = tr A\Bg_. Now, for positive 
semidefinite matrices A, B, the two statements tr A*B = and AB = are equivalent. 
But A^Bg = is equivalent to U k := im A& C ker Bg =: Vg. D 

4.1. The case Ik = R. For positive semidefinite matrices with real entries, the following is 
well-known. 

Lemma 4.7 (E.g. [1]). Let Ax, ... , A m be square matrices, and ai, . . . , a m numbers. If 
there exists a real positive semidefinite matrix X such that ti{A*X) = ctjforj = 1, . . . , m, 

then there exists such a matrix X with rank at most (v8m + l)/2. 

Proof of Lemma 4.5. This lemma is an easy consequence of Lemma 4.7. We leave the easy 
details to the reader. □ 

5. Triangular rank and proofs of Theorems 2.5 and 2.8. 

We start this section with a corollary to Theorem 1.1. Recall that the trianglular rank 
of a matrix is the order of the largest square submatrix which, after suitable permutation of 
rows and columns, is (upper or lower) diagonal, with non-zero entries along the diagonal. 

Corollary 5.1. Let S be a nonnegative matrix. The triangular rank of S is a lower bound 
to the positive semidefinite rank of S. 

Note that, in the case that Qo = Q\ (i.e., S is the slack matrix of a pointed polyhedral 
cone), the triangular rank is trivially equal to rk S. In [10], this fact is used to prove a lower 
bound for stable set polytopes. 

The statement of the corollary is a trivial consequence of the second equation in Theo- 
rem 1.1. However, we give a proof based on the subspace-lattice embedding rank (the first 
equation in the theorem), to illustrate this method. 

Proof of Corollary 5.1. W.l.o.g., we may assume that S itself is a square lower-triangular 
matrix of order t. Let U\, . . . , Ut, V\, . . . , Vt be linear subspaces of k q which satisfy (1). 
Since 5(1, 1) / 0, we have Ux £ V±, whence U x 2 (0). 
Since 5 is lower-triangular, we have, for k = 1, . . . , t — 1, 

Ux + --- + U k c V k+1 

U x + --- + U k + U k+1 £ Vjfe+i, 
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where the last inequality follows from S(k + 1, k + 1) ^ 0. Letting 



W k :="£lJ : 



k 

1 r; . 



for k = 0, . . . , t (so that Wo = (0)), we conclude that, for k = 0, . . . , t — 1, 

and it follows that t < q. □ 

We now prove Theorems 2.5 and 2.8 by giving lower bounds on the the triangular rank 
of the respective slack matrices. 

Proof of Theorem 2.5. Let Pq denote the cut polytope on the complete graph on n vertices, 
and let P\°, P± A , P^ 00 as defined on page 6. 

For a vertex set W C [n], denote by 5(W) := {uv G E n \ u G W,v ^ VF} the cut 
defined by the bipartition (W, [n] \ T4 7 ) of the vertex set. 

As mentioned in Remark 2.6, Theorem 2.5(a) can be proved either by the trivial rank 
lower bound or by support-based arguments. We give both proofs. 

Proof of Theorem 2.5(a), rank-based version. As mentioned above, the dimension of the 
polyhedron Pq is (™) and P\° is pointed, so that the dimension of the slack matrix is (™) + 1. 
Consequently (see Footnote 1), if g is the psd-rank of the slack matrix, we have yX) + 1 < 
( ? 2 ), implying q > n — 1. □ 

Proof of Theorem 2.5(a), support-based version. We have to prove that every semidefinite 
extension of Pq C Pi° has size at least n. In view of Corollary 5.1, we identify, in the 
slack matrix S of Po C P\°, a lower triangular matrix of size n with non-zeroes along the 
diagonal. 

The rows of the slack matrix S are indexed by edges of the complete graph; the columns 
are indexed by cuts. For an edge e and a cut c = 5(W) we have S(e, c) = if and only 
if e G c, or, in other words, S(e, c) ^ if and only if e C W or e n W = 0. For ease of 
notation, we identify the vertex set of K n with Z n . Consider the following subset of rows 

ej -={j,j + 1}, forj = 0, ...,n-2, 

and the subset of columns 



U/2J 

^ := {j + 1} U (j{j- 2i}, for j = 0, 

i=0 



,n 



In words, if j is even then Wj is the set of even numbers up to and including j, and the 
number j + 1; if j is odd, then VFj is the set of odd numbers up to and including j, and the 
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number j + 1. For j = n — 1 we define e n _i := {n — 1, n — 1 mod 2} and 

L(n-1)/2J 

W n -i:= U {n-l-2i}. 

i=0 

In words, VK n _i is the set of numbers in Z n of the same parity as n — 1. 

Clearly, we have ej C Wj for j = 0, . . . , n — 1. Now consider e* and Wj for some 
< i < j < n — 1. As Wj contains all numbers less than j of the same parity it will 
contain one of {i, i + 1}; however, it will not contain the other as the only number in Wj of 
opposite parity is j + 1 > i + 1. In the case of W n -\, it contains exactly those numbers of 
the same parity as n — 1, thus will contain exactly one of {i, i + 1} for i = 0, . . . , n — 2. 

This shows that the submatrix 

{S(e l ,5(W j )) l=0 _ n - 1 , 

j=0,...,n-l 

is lower triangular with non-zeros on the diagonal. 

□ 

Obviously, the trivial rank lower bound of Footnote 1 cannot yield items (b) or (c) of 
Theorem 2.5. 

A 



Proof of Theorem 2.5(b). We have to prove that every semidefinite extension of P$ C P\ 
has size (1 + o(l))n 2 /2. For this, we construct an lower triangular matrix of size t := ("^ 2 ) 
within the slack matrix, and invoke Corollary 5.1. 

The rows of the slack matrix S are indexed by triples of vertices; the triple (n, v, w) 
represents the inequality x uv < x uw + x wv . The columns of S are indexed by cuts. For a 
triple (n, v, w) and a cut c = 5(W), we have S((u, v, w), c) = if and only if one of the 
following three situations occurs: 

u, v, w G W or u, v, w ^ W 

or 

uv £ S(W). 

Now let (wj,Xj), j = 1, ...,£, be a lexicographic enumeration of all pairs (w, x) with 
l<w<u<n — 2. For the cuts, define the sets 

oo 

W e := {w e , ...,x e }n {\{w e + 1} \ \J{x e - 2t - 1} 

i=0 

For the triples, take (uk,Vk, Wk) with and Uk := Xk + 1 and Vk '■= x^ + 2. We now have 

S((uj,Vj,Wj), S(Wj)) / for all j = 1, ... , t, and 

5((«fc,u fc ,ti;fc),<y(Wi)) = ifl<A;<^<i. 

Thus, we have a lower triangular matrix in the sense of Corollary 5.1. □ 
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Proof of Theorem 2.5(c). We have to prove that every semidefinite extension of Pq C p 1 3oc 
has size (1 — o(l))n 2 /2. For this, we construct an upper triangular matrix of size t := ("^ ) 
within the slack matrix, and invoke Corollary 5.1. 

The rows of the slack matrix S are indexed by 3-element sets of vertices; the vertex set 
{u, v, w} represents the inequality x uv + x uw + x wv < 2. The columns of S are indexed 
by cuts. For a vertex set {u, v, w} and a cut S(W), we have S({u, v, w}, 5(W)) = if and 
only if 

{u, v,w}nW ^$ and {u, v, w} \ W / 0. 

Let the 2-element subsets of {2, . . . , n} be enumerated as ei, . . . , ej. Define the 3- 
element vertex sets Uj := {1} U ej, for j = 1, ... ,t, and the cuts Cj := 6(Uj). Then 
S(Uj,Cj) ^ 0, for all j = 1, ... , t, but S(Ui, Cj) = for i / j. Thus, the tx t submatrix 
of S we have just defined is upper triangular (even diagonal) and Corollary 5.1 applies. □ 

Proof of Theorem 2.8. Let Pq denote the Traveling Salesman polytope on the complete 
graph on n vertices, and let Pi dt J denote the Dantzig-Fulkerson-Johnson relaxation as de- 
fined on page 7. 

Proof of Theorem 2.8. We have to prove that every semidefinite extension of Pq C Pi dt} 
has size ( n r ) ■ For this, we exhibit an upper triangular matrix of size ( n ~ ) within the 
slack matrix, and invoke Corollary 5.1. 

We will need only the rows of the slack matrix S which are indexed by edges e G E n , 
corresponding to the inequalities x e > 0. The columns of the slack matrix S are indexed 
by Hamilton cycles C, and we have S(e, C) = if and only if e ^ C. 

To simplify notation, we identify the vertex set of K n with Z n . 

Let R c Z„ x Z„ be defined as R = {(k, I) : k,£ 6 Z n , k < £ - 1,£ < n - 1}. Let 
r := \R\ = ( n ~ ). The starting point for our construction is the Hamilton cycle 

C :={{0,l},{l,2},...,{n-2,n-l},{n-l,0}} 

in K n . For each (k, £) G R, the edge set 

C k ,t := (Cb \ {{k, k + 1}, {£,£ + 1}}) U {{k,£}, {k + 1,1 + 1}} 

forms a Hamilton cycle in K n . Note that all C& t are distinct. Consider the r x r submatrix 
T of S whose rows correspond to the edges e^i ■= {k,£}, (k,£) G R (listed in lexico- 
graphical order), and whose columns correspond to the Hamilton cycles C^/, {k, £) G R. 
We have 5(e M , Cfe/^/) / if and only if (fc, £) = (k',£') or (k,£) = (k' + l,£' + l). As 
(A/ + 1, ^' + 1) occurs after (k', £') in lexographical order, T will be lower triangular with 
non-zero diagonal entries. Thus, the matrix T is a triangular submatrix whose diagonal 
entries are non-zero, whence, by Corollary 5.1, we conclude that rk® S > r = ("^ )■ □ 

6. Outlook 

As we have shown, support-based lower bounds on the positive semidefinite rank of 
a matrix will always be at most the rank. (In fact, one might wonder whether the rank 
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of a matrix is always an upper bound on its positive semidefinite rank, but for each r > 
3, Corollary 4.16 in [10] gives families of matrices with rank r and unbounded positive 
semidefinite rank.) We illustrate how lower bounds which move beyond considering the 
support might be based on subspace-lattice embeddings via Proposition 3.4. 

Example 6.1. With Ik := R, consider the (n x n)-matrix S n where S n (i,j) = (i — j — 
1)(* ~ 3 ~ 2)/2. We have rk S n = 3 for all n, which follows from the expansion 

(i-j- l)(i - j - 2) = (i 2 - 3i + 1) + (f + 3j + 1) - (2ij), 

as each term in parenthesis can be expressed as a rank one matrix. 

We conjecture that the positive semidefinite rank of S n grows unboundedly with n. (Note 
that the bound in [10, Corollary 4.16] does not apply since S n is not the slack-matrix of a 
polytope.) We can prove the following. 

Claim. If n > 6, the positive semidefinite rank of S n is at least 4. 

Proof of the claim. By considering the upper-left 6x6 submatrix, it suffices to prove the 
claim for n = 6: 

"l 3 6 10 15 21" 

13 6 10 15 

13 6 10 

10 1 3 6 

3 10 1 3 

6 3 10 1 

By contradiction, assume that A±, . . . , Aq, B\, . . . , Bq is a positive semidefinite factoriza- 
tion of 56 of order 3. 

Let Uk, Ve be subspaces of R 3 as in Proposition 3.4. Since for k > 3, the kth row 
contains zeros and non-zeros, we have dim Uk > 1 for these k. For the same reason, we 
have dim Vt < 2 for £ < 4. If we had dim Uk = 2 for any k > 3, then, for £, £' with 
Se(k,£) = S§(k,£') = 0, it would follow that Ve = Vy, which is impossible since the £th 
column differs from the £'th. Thus we conclude that dim Uk = 1 for k > 3. Similarly, we 
have dim Vg = 2 for £ < 4. 

But this means that Ak, k > 3, and Bg, £ < 4, are rank-1 matrices. Choose vectors 
Uk, ve G K 3 , k = 3, . . . , 6, £ = 1, . . . , 4, such that Ak = UkU T k , and Be = vgvj. For these 
k,£, we have 

S 6 (k,£) = tr(ukU T k vevj) = (u T k vef = Y(k,£) 2 , 



,9, 



(» 



where we define the rank-3 matrix Y(k,£) := u\ve- Since Y(k,£) = ±y/ 'Se(k,£), we 
may enumerate all the 2 9 possible choices for Y. Doing this, we see that all possible 
choices for Y have rank at least 4, so no such Y can exist, a contradiction. (We note that, 
independently, the technique based on entry-wise square roots has been used and further 
developed in [ 1 1 ] . ) □ 

This example shows how using additional structure of a positive semidefinite factorization- 
for example that if S has a rank-one semidefinite factorization of dimension k then there is a 
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matrix Y of rank k whose entry wise square is S — can lead to improved lower bounds. The 
following concrete problems motivate finding more general methods that can show positive 
semidefinite rank lower bounds larger than the rank. 

As stated in Corollary 2.7, the slack matrix of the important cycle-relaxation of Max-Cut 
has positive semidefinite rank Q(n 2 ). The Boolean rank is 0(n 4 ), and no non-trivial lower- 
bound is known for the nonnegative rank. (For the nonnegative rank, as pointed out in the 
introduction, the rank is a trivial lower bound.) For both the nonnegative and the positive 
semidefinite rank, lower bounds of Q(n 2+e ) for some e > would be very interesting. 

For the slack matrix of the Dantzig-Fulkerson- Johnson relaxation of the Traveling Sales- 
man Problem, an upper bound on the nonnegative rank of 0(n 3 ) is known. It would be 
interesting to improve the lower bounds for both the nonnegative and the positive semidef- 
inite rank (both are Jl(n 2 )). It would be especially interesting to known whether these two 
ranks are within a factor of o(n) of each other in this situation. 

On a more theoretical side, one might ask whether, for a real matrix S, the positive 
semidefinite rank over D< := R can be larger than the positive semidefinite rank over D< := C. 
This mirrors the corresponding problem posed by Cohen & Rothblum [3, Section 5] (cf. [2]) 
regarding the nonnegative rank over the reals of rational matrices. 
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Appendix A. Linear extensions of the cut polytope dominating the 

CLIQUE INEQUALITIES 

Here we prove Remark 2.4. Let Pq denote the cut polytope of a complete graph on n 
vertices, and let Pf as defined on page 6. 

We quickly repeat some definitions from graph theory. Let G be a bipartite graph with 
vertex set X II Y (here, and in what follows, II stands for the disjoint union of two not 
necessarily disjoint sets). A biclique in G is a complete bipartite graph with vertex set 
U II V, for sets U C X, V C Y, which is a subgraph of G. We say that biclique B covers 
an edge (u, v) € E{G), if (u, v) € E(B). The biclique covering number is the minimum 
number of bicliques in G required to cover all edges of G. 

As mentioned in the introduction, the biclique covering number is just the Boolean rank 
of the Boolean X x y-matrix M with M(x, y) = 1 if and only if (x, y) £ E(G). It is a 
lower bound to the nonnegative rank of any matrix S with supp S = M. 

To lower bound the biclique covering number, we will use a lower bound on the commu- 
nication complexity of the unique disjointness problem. For strings x, y of length N, the 
unique disjointness function evaluates to 1 if x n y = and evaluates to if \x fl y\ = 1. 
Otherwise, it is undefined. The specific result we will need is an exponential lower bound 
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on the number of bicliques to cover the ones of unique disjointness, provided that no bi- 
clique covers a zero of the function. This lower bound follows simply from the key lemma 
of Razborov [19] used to prove an Q(n) lower bound on the randomized communication 
complexity of disjointness, and is explicitly stated in [21]. For a textbook treatment, see 
Lemma 4.49 in Kushilevitz & Nisan [16]. 

We now more precisely state the exact result we need. Let N = A£ + 1 be an odd integer. 
Denoting the set of all ^-element subsets of {1, ... , N} by ( e ), let H^ denote the bipartite 

graph with vertex set { g) II { e ), and (x, y) G E(Hn) if and only if x D y = 0. Let Hjy 
denote the bipartite graph on the same vertex set and with (x, y) G E{Hn) if and only if 
\x Pi y\ = 1 (so E(Hn) n E(Hn) = 0). A biclique is called H^-feasible, if it contains no 
edge of Hjy. (It may, however, contain edges which are neither in H^ nor in H^, i.e., it 
might not be a biclique in H^.) 



Theorem A.l ([19, 21]). The number of Hjy -feasible bicliques needed to cover all edges 
fjv 



inH N is2^ N \ 



This theorem was used in [7] to prove their main result. Our usage is different, though. 

Proof of Remark 2.4. By Theorem 2.1, we have to prove that the slack matrix for the relax- 
ation Pq C Pf has nonnegative rank 2 n ( n \ The approach is to bound the Boolean rank. 
For this, we will give a lower bound to the biclique covering number of the following bi- 
partite graph G. The vertices of G are, on the one hand, the cliques U, U C V n , and 
on the other hand the cuts 5(W), W C V n . We have (17, 6(W)) G E(G) if and only if 
\U n <5(W)| < 1^1 /4. In other words, there is no edge between U and S(W), if and only if 
\unw\ = \U\/2. 

We make no attempt to optimize the constant in the exponent. 

Assuming that n = 2 mod 8, let A^ := n/2, £ := [A/4J . Given a list of r bicliques in G 
which cover every edge of G, we construct a covering of the edges of H^ by (at most) r 
bicliques which are 7?Ar-feasible. Consider the sets U with cardinality 2£ — 2 which have 
U n { N + 1, . . . , n} = {N + 1, . . . , N + £ - 2}, and the sets W of cardinality u which 
satisfy Un{N + l,. . . ,n} = {N + l, . . . , N + £-2}, too. Then\UflW\ = \u\/2 = £-l 
if and only if the two ^-element sets x := UC\{1, . . . ,N} and y := Wn{l, . . . , N} satisfy 
\x Pi y\ = 1. Thus, a covering of the the edges of the subgraph of G spanned by this type 
of vertices U and S(W) of G by bicliques in G gives a covering of the edges of Hn by 
^TV-feasible bicliques. By Theorem A.l, such a covering must have 2^ n > bicliques. □ 
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